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Multiscale  Stochastic  Modeling 

Modeling  and  Linking  Strategy  in  Stochastic  Multiscale  Simulation 

Property  Variability 

Property  Variability  Due  to  Microscale  Uncertainties 

Stochastic  Forging  Design 

Stochastic  Forging  Design 

Motivation 


®  Develop  probabilistic  modeling  methods  predicting  location  dependent 
microstructure  and  properties  in  nickel-based  superalloy  turbine  disks. 

9  Issues:  Property  variability  of  turbine  disk  due  to  high-dimensional  multiscale 
sources 


•  Multiscale  material  modeling 

•  Two-phase  superalloy 

•  Multiscale  sources  of  uncertainties 


DoD  STTR  Project: 

N10A-T028, 

Probabilistic  Prediction  of  Location-Specific 
Microstructure  in  Turbine  Disks 


Rolls-Royce  RB211- 
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Figures  courtesy  of  Rolls  Royce,  R.  Mitchell,  and  E.  Nembach,  etc. 


Pairs  of  edge  dislocations 
interacting  with  y'  precipitates 
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Stochastic  Forging  Design 

The  Big  Picture  of  Multiscale  Modeling 

Modeling  Methodologies: 

9  Microscale:  Dislocation  dynamics 
O  Mesoscale:  Crystal  plasticity 

O  Macroscale:  Finite  element  analysis  based  multiscale  forging 
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Microscale  Mecroscale  Macroscale 

Dislocation  Dynamics  Polycrystal  Plasticity  Disk  Forging 
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The  Big  Picture  of  Multiscale  Modeling 

Linking  Strategy: 


Mecroscale 
Polycrystal  Plasticity 

9  Micro-Mesoscale:  Regression  model  that  passes  constitutive  parameters  from 
microscale  to  mesoscale. 

O  Meso-Macroscale:  Homogenization  methods  exchanging  information  between 
both  scales.  Working  with  discrete  polycrystal  aggregates. 


Macroscale 
Disk  Forging 


Uncertainties  propagate  within  each  scale  and  across  scales  (e.g.  processing  and 
microstructure  uncertainties) 
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Uncertainties  in  Microscale  DD  Simulation  of  Precipitation 
Hardened  Nickel-based  Superalloys 


The  properties  of  high  performance  superalloys  are  controlled  by  the  7/  precipitates 
coherently  embedded  in  the  7  matrix.  A  force  is  exerted  on  a  dislocation  when  it  is 
creating  or  recovering  an  anti-phase  boundary  (APB).  The  force  per  unit  length  on 
dislocation  is 

F  =  Xapb 

Dislocation  dynamics  (DD)  simulation  is  adopted  to  investigate  the  hardening 
mechanism  in  microscale. 

Primary  factors  determining  strength  of  superalloys 
9  Volume  fraction  of  7/  precipitates 
9  Precipitate  size  and  spatial  distribution 
9  Anti-phase  boundary  energy  density  (xapb)  distribution 
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Precipitate  Size  Distribution  in  Aged  Alloys 

Aging  of  precipitation  hardened  alloys  leads  to  particle  coarsening.  In 
order  to  match  the  case  of  an  Ostwald  ripened  crystal,  the  particles 
are  chosen  to  be  spherical  with  a  radius  distribution  following  a  WLS 
distribution. 


The  distribution  of  normalized  particle  radius 
p  Ip  =  rm  is  the  mean  radius)  follows 

• m 


9(P)  = 


1.5 

1.5  -  p 


for  0  <  p  <  1 .5, 

g(p)  =  0,  for  p  >  1 .5 

The  spatial  distribution  is  totally  random 
without  overlap. 
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Linking  Between  Mesoscale  and  Microscale 


Hardening  law  in  mesoscale  crystal  plasticity  constitutive  model 

+  £  ia7i 

'  s  0  '  pe  Active 

When  constant  strain  rate  is  applied,  J^peActive  1^7^  I  is  also  a  constant  C.  Integrating 
the  hardening  law  with  respect  to  time,  we  can  modify  it  as 

s(f)  =  §s  -  (§s  -  So)exp(- -  00  „  Ct) 

Ss  -  So 

Extracting  the  slip  resistance  s  relationship  with  time  t  from  DD  simulations,  we  can 
coarse  grain  and  compute  the  parameters  s0,  ss,  and  60  needed  in  the  mesoscale. 
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Maximum  Entropy  Principle  to  Estimate  Material  Parameters 

®  Given  a  specific  configuration,  we  can  fit  the  three  parameters  by  conducting  an 
one  time  simulation.  However,  the  parameters  obtained  are  different  in  DD 
simulations  that  started  from  distinct  configurations  (different  precipitate 
realization,  APB  energy  densities,  volume  fraction  of  7/  phase,  ...). 

9  These  material  parameters  are  treated  as  random  variables  inducing  variability 
of  the  mechanical  properties  of  the  microstructure  at  meso-scale. 

O  Conduct  N  DD  simulations  with  different  configurations.  Then  compute  the  first  n 
moments  of  these  parameters  using  Monte  Carlo  methods. 

N 

E(xk)  =  YJ*i  =  Mk,k  =  1,2,...,n 

i= 1 

9  Use  MaxEnt  to  compute  the  distribution  of  the  parameters  satisfying  the 
constraints. 

p(x)=exp{-^  XkXk)„Z=  [  exp(— kxk)dx 

Z  J  /C=1 

®  These  distributions  are  our  stochastic  input  model  on  the  mesoscale. 
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Representation  of  Two-phase  Polycrystalline  Superalloy 
Microstructures 


9  Two-phase  polycrystalline  microstructures  are  random  fields  in  nature. 

®  The  representation  of  the  microstructure  needs  to  combine  both 
polycrystal  and  two-phase  alloy  features. 

O  The  complete  representation  of  two-phase  polycrystalline 
microstructure  is  high-dimensional. 


Optical  micrographs  of  RR1 000  superalloy:  sub-solvus  heat-treated  for  4/7  at  1 1 30C.  (Courtesy  of  Rob  Mitchell) 
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Uncertainties  in  Mesoscale  Polycrystalline  Microstructures 

Topological  Feature  Space 

®  Grain  size  distribution 
®  Two-phase  microstructure  variation 

Descriptor: 

®  Histogram  of  grain  sizes  (or  "grain  size  vector") 

®  Correlation  functions  n-point  correlation  function 

&  ( riji  rjki  rkh  ■  ■  •  >  rst )  =  ~  j  i{x)f{x  +  rij)l  ( x  +  rik ) 

Linear  path  function 

Z_'(r)  =  —  [  l'(x)l\x  +  n)l'(x  +  2n)...l'(x  +  r)dx 
V  Jv 

Orientational  (texture)  Feature  Space 
d  Orientation  distribution  of  grains 


Descriptor: 

®  Discrete  representation:  Vector  of  Rodrigues 
parameters  17  =  n,-  tan  0/ /2 

®  Continuum  representation:  Orientation  distribution 
function  (ODF) 


Orientation  distribution  in 
Rodrigues  space 
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Linking  Between  Mesoscale  and 

Macroscale 

Homogenization  theory 


O  Deformation  of  a  microstructure  is  controlled  by  the  deformation  gradient  at  the 
corresponding  point  on  the  macroscale.  The  response  and  properties  of  the 
microstructure  are  computed  using  crystal  plasticity  constitutive  models.  Their 
homogenized  values  are  passed  to  the  macroscale. 

O  Response/properties  are  random  fields  that  are  quantified  by  the  microstructure 
uncertainties  in  lower  scales. 


Microstructure 
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Obtaining  Homogenized  Stochastic  Quantities  from  Mesoscale 

Goal:  evaluating  mechanical  response/properties  variability  of  microstructures  (and 
further,  of  the  entire  turbine  disk). 

Steps: 

Q  Model  Reduction:  Given  a  set  of  microstructure  snapshots,  perform  model 
reduction  techniques  to  obtain  low-dimensional  representations  to  reduce  the 
complexity  of  the  stochastic  input  space. 

Q  Direct  Computation:  Interrogate  each  of  the  microstructures  using  direct  models 
to  obtain  its  mechanical  response  and  properties. 

Q  Statistical  Learning:  Estimate  mechanical  response/properties  variability  of 
microstructures  using  stochastic  methods. 

Q  Prediction:  Given  a  new  microstructure,  first  reduce  its  representation  to 
low-dimensional  space.  Then,  predict  its  response/properties  with  quantified 
uncertainties. 
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Model  Reduction  Techniques 

Nonlinear  model  reduction  (manifold  Learning)  on  grain  size 
0  Isometric  mapping. 

®  The  geometry  of  the  manifold  is  reflected  in  the  geodesic  distance  between  point. 
Algorithm 

O  Compute  the  low-dimensional  representations  of  given  high-dimensional  points. 


unraveling  the  curve 


0  Reconstruct  high-dimensional  representation  of  an  arbitrary  point  in 
low-dimensional  space. 
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Karhunen-Loeve  Expansion  on  texture 

9  Construct  covariance  matrix  of  given  samples 


C  = 


®  Solve  eigenvalue  problem  and  obtain  eigenvalues  </>,-  and  eigenfunctions  A of 
the  matrix. 

®  The  truncated  K-L  Expansion  of  the  random  vector  t  is  then  written  as 

^2  _ 

7-(r,  a;)  r(r,  a;)  +  ^  V7 A/0/(r)r?/(a;) 

/=1 

(77/(0;)}  is  a  set  of  uncorrelated  random  variables  whose  distribution  can  be 
estimated  using  the  Maximum  Entropy  Principle. 
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Uncertainty  Quantification:  Propagating  microstructure 
uncertainty  to  material  properties 


Usually,  a  set  of  microstructure  snapshots  are  given,  whose 
properties  can  be  computed  beforehand  (microstructure 
interrogation).  We  are  interested  to  build  a  hypersurface  of  the 
material  properties  in  the  space  of  all  allowable  microstructures.  The 
response/properties  of  a  new  microstructure  (with  complete 
probabilistic  information,  error  bars)  can  then  be  estimated  without 
any  need  to  run  the  corresponding  direct  simulation. 

9  Maximum  Entropy  Principle 

9  Sparse  Grid  Collocation,  HDMR 

»  Bayesian  Regression 
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Method  1 :  Maximum  Entropy  Principle 

»  Sampling  from  low-dimensional  representation  space 

»  Performing  a  number  of  direct  simulations  and  computing 
moments  of  response/properties  using  Monte  Carlo  simulation 

»  Using  Maximum  Entropy  Principle  to  estimate 
response/properties  distributions 
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Method  2:  Adaptive  Sparse  Grid  Collocation  (ASGC) 

9  Mapping  the  low-dimensional  stochastic  (microstructure 
topology)  input  space  to  a  unit  hypercube 

9  Solving  stochastic  partial  differential  equations  (SPDEs)  using 
ASGC  (based  on  sampling  on  the  hypercube) 

ud,q(t,ti)=  EwKM(o 

Hill^cf+gjeB,- 

9  High  dimension  model  representation  (HDMR)  integrated  with 
ASGC  can  also  be  easily  applied. 


Materials  Process  Design  and  Control  Laboratory 


Cornell  University 


Property  Variability 


Multiscale  Stochastic  Modeling 

Modeling  and  Linking  Strategy  in  Stochastic  Multiscale  Simulation 
Property  Variability  Due  to  Microscale  Uncertainties 
Stochastic  Forging  Design 
Stochastic  Forging  Design 

Example:  Mechanical  Response  Variability  of  Nickel  Due  to 
Microstructural  Uncertainties 


Discrete  microstructure  features  representation: 

0  Grain  size  representation:  "sorted  grain  size  vector" 

O  Texture  representation:  vector  of  Rodrigues  parameters 


Microstructure  snapshots  satisfying  certain  constraints  are  provided 

3  Grain  sizes  of  microstructure  have  the  same  mean  size,  standard  deviation, 
and/or  third  order  moment.  Reconstruction  techniques  are  used  to  produce 
microstructure  realizations. 

9  Textures  are  generated  by  the  same  (deformation)  process  controlled  by  several 
random  (process)  variables  (e.g.  forging  rate). 
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Flow  chart 


Effects  of  microstructural  feature  uncertainties  on  macroscopic  effective  stress  distributions  at  e  =  0.2  (N.  Zabaras 
et  al„  2010) 
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Example:  Mechanical  Property  Variability  of  Copper  due  to 
Microstructural  Uncertainties:  Convex  Hull  of  all  Possible 
Properties  and  Affiliated  Probabilities 


Continuum  microstructure  features  representation: 

®  Orientation  distribution  function  (ODF)  in  Rodrigues  fundamental  zone. 
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Method  3:  Bayesian  Regression 

«  Build  an  adaptive  and  sparse  Bayesian  Regression  Model 
(Relevance  Kernel  Machines,  Sparse  Representations) 

M 

y  =  ^  Pi<t>(Xi)  +  e 
/=1 

where  <j>(xi)  denotes  the  basis  functions  (polynomial,  Gaussian, 
radial,  kernels,  etc.)  of  the  low-dimensional  representation  of  the 
microstructures,  and  y  denotes  the  corresponding 
response/property. 

»  Based  on  observed  data,  use  SMC  method  to  estimate  the 
distribution  of  coefficients  in  the  model 

»  Predict  the  property  and  error  bars  of  new  microstructures. 
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An  Adaptive  Bayesian  Prediction  Model 

A  dynamic  method  that  combines  direct  simulation  and  Bayesian  regression  learning 
can  be  introduced. 


®  Perform  model  reduction  of  given 

microstructure  snapshots  and  compute  their 
response/properties  using  direct  simulation. 

®  Construct  a  Bayesian  regression  model 
(sparse  kernel  interpolation)  using  the  given 
data. 

O  Adaptivity  is  built  to  allow  new  data 
(microstructure  and  the  corresponding 
properties)  to  be  used  for  updating  the 
response  hypersurface.  The  variance 
predicted  from  the  predictive  distribution  for  a 
given  input  microstructure  is  used  as  an  error 
criterion  for  adaptivity. 


O  Sequential  Monte  Carlo  is  used  in  building  the 
hypersurface  and  predictive  distribution. 
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Multiscale  Model  Reduction  of  Microstructure  Random  Field 

®  The  microstructure  varies  at  each  point  in  the  (forged)  workpiece  at  different 
realizations  of  the  forging  process. 

O  The  microstructure  also  varies  from  point  to  point  within  the  same  workpiece. 

O  One  can  construct  a  reduced-order  stochastic  model  for  each  point.  But  how  do 
you  account  for  microstructure  correlation  to  avoid  the  curse  of  dimensionality? 

9  Techniques  to  capture  the  correlation  of  microstructures  in  the  continuum. 

®  Most  of  the  computational  methods  are  intractable  unless  we  can  find  the 

correlation  between  all  the  microstructures  and  construct  a  reduced  order  model 

®  Use  a  bi-orthogonal  KLE  decomposition 
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Bi-Orthogonal  Decomposition  (for  Texture  Multiscale  Reduction) 

9 


Start  from  realizations  of  the  texture  random  field  varies  in  both  meso  (s)  and 
macroscale  (x) 

A/(x,s,  uj) 


9  Transform  snapshots  and  construct  covariance  matrix  at  the  meso-scale  using  all 
data  in  the  macroscale. 


C(s,s/) 


a  nr  neim  rijnt 

^££ 

r  j= 1  in= 1  im= 1 


s,  fy)af  (x/m ,  s/,  £,j)r)im\Jjn  | 


®  Solve  the  eigenvalue  problem  to  obtain  the  eigenvalues  and  eigenvectors: 

Pii'&ii  s) 

®  The  spatial  modes  are  obtained  by  integrating  over  mesoscale  variables 


1 


x,s,cu)ds 
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Comparison  between  the  original  microstructure 
and  the  reduced  order  one 
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Effects  of  Uncertainty  in  Initial  Texture 
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Computational  design  of  deformation  processes  for  desired 
microstructure-sensitive  properties  in  the  presence  of  uncertainty 


Design  Objectives: 

»  Variability  in  disk  properties  (tensile  and  fatigue  strength, 
stiffness,  etc.) 

»  Geometric  variability,  Variability  in  obtained  microstructures,  etc. 


Micro-sensitivity  problem  driven  by 
sensitivity  of  deformation  gradient  (F) 
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Computational  design  of  deformation  processes  for  desired 
microstructure-sensitive  properties  in  the  presence  of  uncertainty 


Design  variables  (random): 

»  Process  sequence  considered  (multi-stage  design) 

«  Process  conditions  (e.g.  variabilities  in  preforms,  dies,  operating 
temoerature.  strain  rates,  etc.t  and  initial  microstructures. 
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Challenges 

9  Complex  multistage,  multiscale  and  stochastic  framework 

»  High  dimensional  random  input/output 

9  Large  variabilities  require  new  thinking  of  modeling  of  SPDEs 
(e.g.  Bayesian  predictive  modeling  with  sparse  sampling  vs 
sparse  grids  and  HDMR).  Sparse  grids  were  shown  recently  to 
fail  when  used  with  data-driven  non-linear  stochastic  input 
models  (KPCA,  IsoMap,  etc.). 

9  Need  for  scalable  exascale  computing  algorithms 
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